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Abstract 

A review of the authors's results is given. Several methods are discussed for solving 
nonlinear equations F(u) — /, where F is a monotone operator in a Hilbert space, and 
noisy data are given in place of the exact data. A discrepancy principle for solving 
the equation is formulated and justified. Various versions of the Dynamical Systems 
Method (DSM) for solving the equation are formulated. These methods consist of 
a regularized Newton-type method, a gradient-type method, and a simple iteration 
method. A priori and a posteriori choices of stopping rules for these methods are 
proposed and justified. Convergence of the solutions, obtained by these methods, to 
the minimal norm solution to the equation F(u) = / is proved. Iterative schemes 
with a posteriori choices of stopping rule corresponding to the proposed DSM are 
formulated. Convergence of these iterative schemes to a solution to equation F(u) = f 
is justified. New nonlinear differential inequalities are derived and applied to a study 
of large-time behavior of solutions to evolution equations. Discrete versions of these 
inequalities are established. 

MSC: 47H05, 47J05, 47N20, 65J20, 65M30. 

Keywords, ill-posed problems, nonlinear operator equations, monotone opera- 
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1 Introduction 

Consider equation 



F(u) = f, (1) 



where F is an operator in a Hilbert space H. Throughout this paper we assume that F is 
a monotone continuous operator. Monotonicity is understood as follows: 

(F(u) -F(v),u-v) > 0, Vu,v£H. (2) 

We assume that equation (pQ) has a solution, possibly non-unique. Assume that / is not 
known but fs, the "noisy data", \\fs — /|| < S, are known. 
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There are many practically important problems which are ill-posed in the sense of 
J.Hadamard. Problem ([1]) is well-posed in the sense of Hadamard if and only if(=iff) 
F is injective, surjective, and the inverse operator i 7-1 is continuous. To solve ill-posed 
problem ([I]), one has to use regularization methods rather than the classical Newton's or 
Newton-Kantorovich's methods. Regularization methods for stable solution of linear ill- 
posed problems have been studied extensively (see [11], p2], [35] and references therein). 
Among regularization methods, the Variational Regularization (VR) is one of the fre- 
quently used methods. When F = A, where A is a linear operator, the VR method 
consists of minimizing the following functional: 

\\Au — fs\\ 2 + a|M| 2 — > min . (3) 

The minimizer ug a of problem ([3]) can be found from the Euler equation: 

(A* A + al)u 5 , a = A*f s . 

In the VR method the choice of the regularization parameter a is important. Various 
choices of the regularization parameter have been proposed and justified. Among these, 
the discrepancy principle (DP) appears to be the most efficient in practice (see |llj). 
According to the DP one chooses a as the solution to the following equation: 

\\Au S;a - f S \\=C6, KC = const. (4) 

When the operator F is nonlinear, the theory is less complete (see [2], [34]). In this 
case, one may try to minimize the functional 

\\F( U )-f s \\ 2 + a\\u\\ 2 ^ mm. (5) 

as in the case of linear operator F. The minimizer to problem ([5]) solves the following Euler 
equation 

F'(v>S >a )*F(u s>a ) + au s ^ a = F'{u S]<x )*fs- (6) 

However, there are several principal difficulties in nonlinear problems: there are no general 
results concerning the solvability of ([6]) , and the notion of minimal-norm solution does not 
make sense, in general, when F is nonlinear. Other methods for solving ([1]) with nonlinear 
F have been studied. Convergence proofs of these methods often rely on the source-type 
assumptions. These assumptions are difficult to verify in practice and they may not hold. 

Equation ([1]) with a monotone operator F is of interest and importance in many 
applications. Every solvable linear operator equation Au = / can be reduced to solving 
operator equation with a monotone operator A* A. For equations with a bounded operator 
A this is a simple fact, and for unbounded, closed, densely defined linear operators A it is 
proved in [26], [28], [29], [13]. 

Physical problems with dissipation of energy often can be reduced to solving equations 
with monotone operators [32J. For simplicity we present the results for equations in Hilbert 
space, but some results can be generalized to the operators in Banach spaces. 

When F is monotone then the notion minimal- norm solution makes sense (see, e.g., 
[131 p. 110]). In [33J, Tautenhahn studied a discrepancy principle for solving equation ([T]). 
The discrepancy principle in [33J requires solving for a the following equation: 

\\(F'(us, a ) + al)- 1 ^^) - f s )\\ = C6, 1<C = const, (7) 
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where us t a solves the equation: 

F(u8,a) + aU8,a = fs- 

For this discrepancy principle optimal rate of convergence is obtained in [33J. However, the 
convergence of the method is justified under source- type assumptions and other restrictive 
assumptions. These assumptions often do not hold and some of them cannot be verified, 
in general. In addition, equation ([7j) is difficult to solve numerically. 

A continuous analog of the Newton method for solving well-posed operator equations 
was proposed in [3], in 1958. In [I], [IJ-pII], and in the monograph [13] the Dynamical Sys- 
tems Method for solving operator equations is studied systematically. The DSM consists 
of finding a nonlinear map &(t,u) such that the Cauchy problem 

u = $(t,u), u(0) = n , (8) 

has a unique solution for all t > 0, there exists lim^oo u(t) := u(oo), and F(u(oo)) = f, 

3\ u(t) Vt > 0; 3u(oo); F(u(oo)) = f. (9) 

Various choices of <3? were proposed in [13] for to hold. Each such choice yields a version 
of the DSM. 

In this paper, several methods developed by the authors for solving stably equation 
(TjQ) with a monotone operator F in a Hilbert space and noisy data f$, given in place of 
the exact data /, are presented. A discrepancy principle (DP) is formulated for solving 
stably equation (TjQ) is formulated and justified. In this DP the only assumptions on F are 
the continuity and monotonicity. Thus, our result is quite general and can be applied for 
a wide range of problems. Several versions of the Dynamical Systems Method (DSM) for 
solving equation ([IJ) are formulated. These versions of the DSM are Newton-type method, 
gradient-type method and a simple iterations method. A priori and a posteriori choices 
of stopping rules for several versions of the DSM and for the corresponding iterative 
schemes are proposed and justified. Convergence of the solutions of these versions of 
the DSM to the minimal-norm solution to the equation F(u) = f is proved. Iterative 
schemes, corresponding to the proposed versions of the DSM, are formulated. Convergence 
of these iterative schemes to a solution to equation F{v) = f is established. When 
one uses these iterative schemes one does not have to solve a nonlinear equation for the 
regularization parameter. The stopping time is chosen automatically in the course of 
calculations. Implementation of these methods is illustrated in Section 6 by a numerical 
experiment. In Sections 2 and 3 basic and auxiliary results are formulated, in Section 4 
proofs are given, in Section 5 ideas of application of the basic nonlinear inequality (94) 
are outlined. 

2 Basic results 

2.1 A discrepancy principle 

Let us consider the following equation 

F(Vs, a ) + aV s<a ~fs = 0, a > 0, (10) 
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where a = const. It is known (see, e.g., [13^, p. Ill]) that equation (jlOp with a monotone 
continuous operator F has a unique solution for any fg G H. 

Assume that equation ([TJ has a solution. It is known that the set of solution Af := {u : 
F(u) = /} is convex and closed if F is monotone and continuous (see, e.g., [13] ; p. 110). 
A closed and convex set Af in H has a unique minimal- norm element. This minimal-norm 
solution to (P) is denoted by y. 

Theorem 1 Let 7 € (0, 1] and C > be some constants such that CS" 1 > 5. Assume that 
\\F(0) — fs\\ > C5 1 . Let y be the minimal-norm solution to equation (pQ). Then there exists 
a unique a (5) > such that 

\\F(V SMS) )-f 5 \\ = C5\ (11) 

where Vg^s) solves (Jlj) with a = a(5). 
If < 7 < 1 i/ien 

lim\\V SMS) -y\\ = 0. (12) 

Instead of using (fTUj) . one may use the following equation: 

+ a(^,a -u)-f 5 = 0, a > 0, (13) 

where u is an element of H. Denote F\(u) := F(u + u). Then F± is monotone and 
continuous. Equation fjl3[> can be written as: 

Fi(U s , a ) + aU s , a - f s = 0, Us, a :=V Sta -u, a > 0. (14) 

Applying Theorem [1] with F = F± one gets the following result: 

Corollary 2 Let 7 G (0, 1] and C > be some constants such that C5 1 > 5. Let u € H 
and z be the solution to (pQ) with minimal distance to u. Assume that \\F(u) — f$\\ > C<5 7 . 
Then there exists a unique a(5) > such that 

\\F(V 5M5) ) - f s \\ = C5\ (15) 
where Vg^s) solves the following equation: 

F(V 5 , a ) + a(5)(V 5 ,a -u)-f s = 0. (16) 
7/7 6 (0, 1) then this a(5) satisfies 

lini||^ a(5) -z||=0. (17) 

The following result is useful for the implementation of our DP. 

Theorem 3 Let 6,F,fg, and y be as in Theorem^ and < 7 < 1. Assume that vg S H 
and a(5) > satisfy the following conditions: 

\\F(v s ) + a(5)vs- fs\\<05, 6 > 0, (18) 

and 

< \\F(v s ) - Ml < C 2 5\ < d < C 2 . (19) 

Then one has: 

lim \\v& - y\\ = 0. (20) 
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Remark 1 Based on Theorem [3] an algorithm for solving nonlinear equations with mono- 
tone Lipchitz continuous operators is outlined in [9]. 

Remark 2 It is an open problem to choose 7 and C optimal in some sense. 

Remark 3 Theorem Q] and Theorem [3] do not hold, in general, for 7 = 1. Indeed, let 
Fu = {u,p)p, \\p\\ = 1, p _L N(F) := {u € H : Fu = 0}, / = p, fs = p + qd, where 
(p, q) = 0, \\q\\ = 1, Fq = 0, \\q5\\ = 5. One has Fy = p, where y = p, is the minimal-norm 
solution to the equation Fu = p. Equation Fu + au = p + q5, has the unique solution 
Vs,a = qS/a + p/(l + a). Equation (fTTjl is C5 = \\q5 + (ap)/(l + a)\\. This equation 
yields a = a(5) = c5/(l — c5), where c := (C 2 — l) 1 / 2 , and we assume c5 < 1. Thus, 
lim^o ^5,a(<5) = P + c _1 g := v, and = p. Therefore v = lim^o Vs,a(8) is n °t i-e., is 
not the minimal-norm solution to the equation Fu = p. This argument is borrowed from 

m p- 29]. 

If equation (P) has a unique solution and 7 = 1, then one can prove convergence (fT2|) 
and (120]) . 

2.2 The Dynamical Systems Method 

Let a(t) \ be a positive and strictly decreasing sequence. Let Vg(t) solve the following 
equation: 

F(V 5 (t)) + a(t)V s (t) - f s = 0. (21) 

Throughout the paper we assume that equation F(u) = f has a solution in H, possibly 
nonunique, and y is the minimal-norm solution to this equation. Let / be unknown but 
f s be given, \\f s - f\\ < 5. 

2.2.1 The Newton- type DSM 

Denote 

A:=F'(u s (t)), A a :=A + aI, (22) 
where I is the identity operator, and u$(t) solves the following Cauchy problem: 

u s = -A-^[F(u s ) + a(t)u 5 - fs], u s {0) = u . (23) 

We assume below that \\F(u Q ) - f s \\ > C^, where C t > 1 and ( G (0,1] are some 
constants. We also assume without loss of generality that 5 E (0, 1). Assume that equation 
(HJ) has a solution, possibly nonunique, and y is the minimal norm solution to equation 
([I]). Recall that we are given the noisy data fs, \\fs — f\\ < 8. 
We assume in addition that 

\\FW(u)\\ < Mj(R,u ), Vn G B(u ,R), 0<j<2. (24) 

This assumption is satisfied in many applications. 
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Lemma 4 ([6] Lemma 2.7) Suppose M\,cq, and c\ are positive constants and ^ y G 
H. Then there exist A > and a function a(t) G C^fO, oo), < a(t) \ 0, such that the 
following conditions hold 



< A, 



ci- 



< 



< 



A 



IMI 

a(t) ~ 2a(t) 
\a(t)\ ^ a(t) 
2A 

a 2 (0) 
A 



a(t) 

imo)- mi < 



i 



\a(t)\ 
a(t) 
[a(t)| 



a(t) 



In the proof of Lemma 2.7 in [6] we have demonstrated that conditions 



(25) 
(26) 
(27) 

(28) 
are 



satisfied for a(t) 
sufficiently large. 



(c+ty 



-, where 6 G (0,1], c,d>0 are constants, c > 66, and d is 



Theorem 5 Assume a(t) = r c £ t \b > where 6 G (0,1], c,d> are constants, c > 66, and 
d is sufficiently large so that conditions (|26p - (|28p ZioZd. Assume that F : H ^ H is a 
monotone operator, (|24p holds, Uq is an element of H , satisfying inequalities 



VoW < 



im (n , Ml > h(0) = \\F(u )+a(0)u -f s \\<ja(0)\\V S (0)\\. (29) 
a(U) 4 



TTien £/ie solution us(t) to problem (|23p exists on an interval [0, Tj], lim^o^s = °°> anc ^ 
f/iere exists a unique t$, t$ G (0, ?#) sitc/i i/iai lim^o^ = 00 anc ^ 



II^M**)) - Ml = C x 5<, \\F(u 5 (t) -f 5 \\> Cx$, Vt G [0, ti), 
where C\ > 1 and < £ < 1. 7/C G (0, 1) and t{ satisfies (|30|) . i/jen 

lim ||«tf(*i) - y|| = 0. 



(30) 



(31) 



Remark 4 One can choose uo satisfying inequalities (|29|) (see also (|199p ). Indeed, if uo is 
a sufficiently close approximation to Vs(0) the solution to equation (i2~Tj) then inequalities 
(f29"P are satisfied. Note that the second inequality in ([29]) is a sufficient condition for (|20ip . 
i.e., 

e-H(0) < io(t)||V^(0)|| < io(t)||^(t)||, i > 0, (32) 

to hold. In our proof inequality (f32|) (or inequality (|20ip ) is used at t = tg. The stopping 

-is. 

time t,5 is often sufficiently large for the quantity e 2 ho to be small. In this case inequality 
(f32j) with £ = t<5 is satisfied for a wide range of no- 
Condition c > 66 is used in the proof of Lemma [271 
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2.2.2 The Dynamical system gradient method 

Denote 

A := F'(u s (t)), A a :=A + aI, a = a(t), 
where I is the identity operator, and us(t) solves the following Cauchy problem: 

u s = -A* a ^[F(u s ) + a(t)u s - f s ], u s (0) = u . (33) 

Again, we assume in addition that 

WF^iu^KMjiR^o), VuG5(u ,i?), < j < 2. (34) 

This assumption is satisfied in many applications. 
Let us recall the following result: 

Lemma 6 (|7J Lemma 11) Suppose M\,cq, and c\ are positive constants and ^ y G 
H. Then there exist A > and a function a{t) G C^O, oo), < a(t) \ 0, such that 

, m a 3 (t) , s 

\a(t)\ < (35) 



and the following conditions hold 



< 06) 

\\y\\ 



c {M 1 + a(t)) < 



2a 2 (t) 



2 M 2|d(t)| 



|d(t)| a 2 (i) 



a'(f) 
a 2 (i) - 



a(t) 
2\a(t)\ 
a{t) 



(37) 
(38) 



a{t) ~ 2A 

A ff(0)<l. (39) 



a 2 (0)' 

We have demonstrated in the proof of Lemma 11 in [7J that conditions f)35|) — f)39|) are 
satisfied with a(t) = , where 6 G (0, |], c > 1, and cZ > are constants, and d is 

sufficiently large. 

Theorem 7 Let a(t) satisfy conditions ([35]) - ([39]) of Lemma® For example, one can 
choose a(t) = , where b G (0, j], c > 1, and d > are constants, and d is sufficiently 
large. Assume that F : H ^ H is a monotone operator, ([34"]) holds, uq is an element of 
H , satisfying inequalities 

h(0) = \\F(u ) + a(0)u - M| < ~a(0)||^(0)||, (40) 

Then the solution u$(t) to problem ([33]) exists on an interval [0,Ts], lim^o^s = oo, and 
there exists tg, t$ G (0,T§), not necessarily unique, such that 

\\F(Mts)) ~ Ml = C^, \im t s = oo, (41) 

o— >0 

where C\ > 1 ana 1 < £ < 1 are constants. If £ G (0, 1) and ^ satisfies (14ip . i/ien 

lim ||u 5 (t 5 ) — 2/|| =0. (42) 

o— >0 
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Remark 5 One can easily choose uo satisfying inequality . Note that inequality ([30]) 
is a sufficient condition for inequality (|243p . i.e., 

e-U(O) < ^o(t)||^(0)|| < \a(t)\\Vg(t)\\, t > 0, (43) 

to hold. In our proof inequality (|243l) (or (f4"3l) ) is used at i = tg. The stopping time tg is 
often sufficiently large for the quantity e~ v ^ ts 'ho to be small. In this case inequality (|43p 
(or (I243P ) with t = tg is satisfied for a wide range of uq. The parameter £ is not fixed 
in (|4ip . While we could fix it, for example, by setting £ = 0.9, it is an interesting open 
problem to propose an optimal in some sense criterion for choosing 



2.2.3 The simple iteration DSM 

Let us consider a version of the DSM for solving equation ([I]) : 

ug = - (F(ug) + a(t)ug - fs) , ug(0) = uo, (44) 

where F is a monotone operator. 

The advantage of this version compared with (|23|) is the absence of the inverse operator 
in the algorithm, which makes the algorithm (|44p less expensive than (I23p . On the other 
hand, algorithm (|23p converges faster than (|44p in many cases. The algorithm (|44p is 
cheaper than the DSM gradient algorithm proposed in (|33p . 

The advantage of method (j44l) . a modified version of the simple iteration method, 
over the Gauss-Newton method and the version (|23p of the DSM is the following: neither 
inversion of matrices nor evaluation of F' is needed in a discretized version of (|44f) . Al- 
though the convergence rate of the DSM (|44p maybe slower than that of the DSM (|23p . 
the DSM ([4*4"]) might be faster than the DSM ([23]) for large-scale systems due to its lower 
computation cost. 

In this Section we investigate a stopping rule based on a discrepancy principle (DP) for 
the DSM (|44p . The main results of this Section is Theorem [9] in which a DP is formulated, 
the existence of a stopping time tg is proved, and the convergence of the DSM with the 
proposed DP is justified under some natural assumptions. 

Let us assume that 

sup \\F'(u)\\<M 1 (u ,R). (45) 

u£B(u ,R) 

Lemma 8 (|8j Lemma 11) Suppose M\ and c\ are positive constants and ^ y G H . 
Then there exist a number A > and a function a(t) £ C [0, oo) ; < a(t) \ 0, such that 

W)\ < (46) 
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and the following conditions hold 

Mi 



„ < A, (47) 

y\\ 



2a{t) 



a(t) 



\a(t)\ a(t) 
c l — 77T - 



a(t) 



a(t) 

mi 

a(t) J 



(48) 
(49) 



a(t) ~ 2X 

A 5(0) < I- (50) 



a(0) 

It is shown in the proof of Lemma 11 in [8] that conditions f|46|) — (|50[) hold for the 
function a(t) = j^ju, where b G (0, |], c > 1 and d > are constants, and d is sufficiently 
large. 

Theorem 9 Let a(t) satisfy conditions (|46p ~ (|50p in Lemma -For example, one can 
choose a(t) = , where b G (0, c > 1 and d > are constants, and d is sufficiently 

large. Assume that F : H ^ H is a monotone operator, condition ()45p holds, and uq is 
an element of H, satisfying inequality 

MO) = \\F(uo) + a(0)n - M| < ~a(0)||^(0)||, (51) 

Assume that equation F(u) = f has a solution y G B(uq,R), possibly nonunique, and y is 
the minimal-norm solution to this equation. Then the solution us(t) to problem (|44p exists 
on an interval [0,Ts], lim^o^s = an d there exists t$, t$ G (Q,T$), not necessarily 
unique, such that 

\\F(u 5 (t s )) - Ml = CiS<, lim t s = oo, (52) 

o— >0 

where C\ > 1 and < ( < 1 are constants. If ( G (0, 1) and t$ satisfies (l52j) . i/ien 

lim ||n 5 (^) - y|| = 0. (53) 

Remark 6 One can easily choose no satisfying inequality (|5ip (see also (|278p ). Again, 
inequality (|5ip is a sufficient condition for (143)) (or (|282h ) to hold. In our proof inequality 
(f4~3"P is used at t = ts. The stopping time is often sufficiently large for the quantity 
e~^( t6 ^ho to be small. In this case inequality (I43p with t = tg is satisfied for a wide range 
of no- 

2.3 Iterative schemes 

Let < a n \ be a positive strictly decreasing sequence. Denote V n := V n ^ where V n ,$ 
solves the following equation: 

F(V niS ) + a n V n , s -f S = 0. (54) 
Note that if a n := a(t n ) then V nt s = Vs(t n ). 



9 



2.3.1 Iterative scheme of Newton-type 

In this section we assume that F is monotone operator, twice Frechet differ entiable, and 
\\F {j) (u)\\ < Mj(R,Uo), Vu G B(u ,R), 0<j<2. (55) 
Consider the following iterative scheme: 

Un+i = u n - A~ x [F(u n ) +a n u n - fg], A n := F'{u n ) + a n I, u = u , (56) 
where uq is chosen so that inequality (|62p holds. Note that F'(u n ) > since F is monotone. 

Thus, \\a^\\<^. 

Lemma 10 (|5j Lemma 2.5) Suppose M\,cq, and c\ are positive constants and ^ 
y G H . Then there exist A > and a sequence < (a n )^L \ such that the following 
conditions hold 

a n < 2a„ + i, (57) 

\\fs-F(0)\\<^, (58) 

Mi „ , x 

-j- < hi (59) 

0"n — a n+l , 1 



< ^ (60) 
<+i 2ciA 

C 0T2 H C l - ( 61 ) 

X z a n+ i A 

It is shown in the proof of Lemma 2.5 in [5] that conditions (|57p - (|6ip hold for the 
sequence a n = pq^js , where d > 1, < b < 1, and do is sufficiently large. 

Remark 7 In Lemmas [TOHHl one can choose oo and A so that 2fi i s uniformly bounded 
as 5 — > even if M\{R) — > oo as i? — > oo at an arbitrary fast rate. Choices of ao and A to 
satisfy this condition are discussed in [5], [7] and [8]. 

Let a n and A satisfy conditions (f57]) - (f6"Tj) . Assume that equation F{u) = f has a 
solution y € B(uo,R), possibly nonunique, and y is the minimal-norm solution to this 
equation. Let / be unknown but fg be given, and ||/<5 — /|| < 5. We have the following 
result: 

Theorem 11 Assume a n = nr^TB where d > 1, 0<6< 1, and do is sufficiently large so 
that conditions (foTj) - (foTj) hold. Let u n be defined by ([SB]) . Assume that no «s chosen so 
that \\F(uq) - fg\\ > Ci5~< > 5 and 

3o := IN - Vq\\ < . (62) 

a 

Then there exists a unique ng, depending on C\ and 7 (see below), such that 

\\F(u ns ) - f s \\ <dF, dP< \\F(u n ) - f s \\, Vn<n 5 , (63) 
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where C\ > 1, < 7 < 1. 

Let < (5 m )^ =1 be a sequence such that 5 m — > 0. If N is a cluster point of the 
sequence n$ m satisfying ([6"5j) . i/ten 



lim M„ Sm = u*, (64) 

m— >oo m 

where u* is a solution to the equation F(u) = f. If 

lim n Sm = 00, (65) 

and 7 G (0, 1), then 



lim IKa m - V\\ = °- ( 66 ) 
Note that by Remark [HI inequality ([62]) is satisfied with uq = 0. 

2.3.2 An iterative scheme of gradient-type 

In this section we assume that F is monotone operator, twice Frechet differ entiable, and 

\\F^(u)\\ < Mj(R,uo), Vu G B(u ,R), 0<j<2. (67) 

Consider the following iterative scheme: 

u n+1 = u n - a n A* n [F(u n ) + a n u n - f s ], A n := F'(u n ) + a n I, u = u , (68) 

where uq is chosen so that inequality ([76"[) holds, and {a n }™ =1 is a positive sequence such 
that 

2 

< a < a n < -2, A n | \<Mt + a n . (69) 

a l n + (Mi + o n )^ 

It follows from this condition that 

|| 1 - a n A* an A an || = sup |1 - a n \\ < 1 - a n a\. (70) 

<4<A<(A-/i+a„) 2 

Note that F'(u n ) > since F is monotone. 

Lemma 12 ([7j Lemma 12) Suppose Mi,cq,c\ and a are positive constants and 7^ 
y G -ff . T/ien i/iere exisi A > and a sequence < (an)^=o \ swc/t £/iai i/ie following 
conditions hold 

— < 2, (71) 



«n+l 

||/ 5 -F(0)||<^, (72) 

< IMI, (73) 

cp(Mi + ag) < 1_ 
A 2 



2 - 4 2 
x n aa n a n — a n +\ a n -\-i 



, )X + ci < — — . (75) 
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It is shown in the proof of Lemma [12] in [7j that the sequence satisfying conditions 
T])- ([75|) can be chosen of the form a n = ^ n ^ b > where c > 1, < 6 < |, and d is 
sufficiently large. 

Assume that equation F(u) = f has a solution in B(uq,R), possibly nonunique, and 
y is the minimal-norm solution to this equation. Let / be unknown but fg be given, and 
||/<5 — /|| < S. We prove the following result: 

Theorem 13 Assume a n = jt^xb where c>l,0<6<|, and d is sufficiently large so 
that conditions (|71|) - (|75p hold. Let u n be defined by (j68[) . Assume that uq is chosen so 
that \\F(uq) — fs\\ > Ci5 7 > 5 and 

II t/ I, / \\F(0)-fs\\ (7r , 

9o ■= \\uq-Vo \\ < . (76) 

a 

Then there exists a unique ng such that 

\\F(u ns ) - M| < C^, CiS< < \\F(u n ) - M|, Vn < n s , (77) 

where C\ > 1, < ( < 1. 

Lei < (<5 m )^ =1 6e a sequence such that 5 m — > 0. // £/te sequence {n m := ^<s m }m=i * s 
bounded, and {n mj }'^L 1 is a convergent subsequence, then 

lim = w, (78) 

where u is a solution to the equation F(u) = f . If 

lim n m = oo, (79) 

m-— >oo 

anc? C E (0, 1), £/ien 



lim \\u nm - y\\ = 0. (80) 
It is pointed out in Remark [8] that inequality (j76[) is satisfied with no = 0. 

2.3.3 A simple iteration method 

In this section we assume that F is monotone operator, Prechet differ entiable. 
Consider the following iterative scheme: 

u n +i = u n - a n [F(u n ) + a n u n - f s ], n = u , (81) 

where no is chosen so that inequality (f88l) holds, and {a„}™ =1 is a positive sequence such 
that 

0<a<a n < — — -, Mi{u Q ,R)= sup \\F'{u)\\. (82) 

a n + (Mi + a n ) ueB{u ,R) 

It follows from this condition that 

|| 1 - a n (J n + a n ) || = sup |1 - OnX\ < 1 - a n a n . (83) 

a„<X<Mi+a n 

Here, J n is an operator in H such that J n > and || J n || < M\, Vn E B(uo, R)- A specific 
choice of J n is made in formula (I336P below. 
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Lemma 14 (|8j Lemma 12) Suppose Mi, c\ and a are positive constants and ^ y € 
H . Then there exist a number A > and a sequence < {a n ) c ^ = Q \ such that the 
following conditions hold 

"" <2, (84) 



\\fs-F(0)\\<^, (85) 

Mi „ , , N 

~Y < hi (86) 

~ 2 

— + ci < — — . (87) 

A A a«+i A 

It is shown in the proof of Lemma 12 in [8] that conditions (|84 p - (|87p hold for the 
sequence a n = j^^e, where c>l,0<b<g, and d is sufficiently large. 

Let a n and A satisfy conditions ([84"[) - ([8T[) . Assume that equation F(u) = f has a 
solution y S B(uq,R), possibly nonunique, and y is the minimal- norm solution to this 
equation. Let / be unknown but f$ be given, and \\f$ — f\\ < 5. We prove the following 
result: 

Theorem 15 Assume a n = where c > 1, < b < |, and d is sufficiently large so 



that conditions (184j) -( 1871) hold. Let u n be defined by (18ip . Assume that uq is chosen so 
that \\F(uq) - fs\\ > Ci5 7 > 5 and 

II T/ll < 

9o ■= IN - Vol I < - 



a 

T/ien i/iere exists a unique ng such that 

\\F(u ns ) - M| < Ci^, Ci^ < ||FK)-M|, Vn<n 5 , 

w/tere Ci > 1, < ( < 1. 

Let < (5 m )m=i be a sequence such that 5 m — > 0. If the sequence {n m := ns m }^ =1 is 
bounded, and {n mj } r jL 1 is a convergent subsequence, then 

lim u n = u, (90) 

where u is a solution to the equation F(u) = f . If 

lim n m = oo, (91) 

7" 

anc? £ £ (0, 1), then 



m— >oo 



lim K m - y|| = 0. (92) 

m— >oo 

According to Remark [HI inequality ([88]) is satisfied with uq = 0. 
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2.4 Nonlinear inequalities 

2.4.1 A nonlinear differential inequality 

In [13] the following differential inequality 

g{t) < -j{t)g(t) + a(t)g 2 (t) + P(t), 



t > T , 



(93) 



was studied and applied to various evolution problems. In (|93l) a(t), P(t),j(t) and g(t) 
are continuous nonnegative functions on [ro,oo) where To is a fixed number. In [13] . an 
upper bound for g(t) is obtained under some conditions on a, (3, 7. In [10] the following 
generalization of (|93l) : 



< -7(*M*) + a(*)p"(t) + /?(*), * > ro, V > 1, 



(94) 



is studied. 

We have the following result: 



Theorem 16 ([10J Theorem 1) Let a(t), (5{t) and^(t) be continuous functions on [to, 00) 
and a(t) > 0, Vi > tq. Suppose there exists a function fj,(t) > ; \i € C [to, 00), suc/i i/iai 



^, x 1 



7 



fi(t) 



M (t) 



/xP(t) ' " w " M (t) 
Ze£ g(i) > fee a solution to inequality (|94p suc/i f/jai 

MOo)ffOo) < 1. 
T/ien g(i) exists globally and the following estimate holds: 

1 



< g(t) < 



fx(ty 



Vt > T . 



Consequently, if ]jmt-^ 00 fj,{t) = 00, then 

lim = 0. 

t^oo 

When p = 2 we have the following corollary: 
Corollary 17 (|13j p. 97) If there exists a monotonically growing function fi(t), 



(95) 



(96) 



(97) 



(98) 



fi € C^^oo), [i > 0, lim /z(i) = 00, 



such that 



< a(t) < 



7 



A»(t) 

M (t) 



u :- 



du 



m(to)5(to) < 1, 



(99) 

(100) 
(101) 
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where a(t), f3(t),^(t) and g(t) are continuous nonnegative functions on [ro,oo) ; tq > ; 
and g(t) satisfies (|93p. then the following estimate holds: 

< g(t) < Vi > r . (102) 

If inequalities ([99|) - ()10ip /io£d on an interval [to,T), then g(t) exists on this interval and 
inequality (1102j) ZioZds on [to,T). 

2.4.2 A discrete version of the nonlinear inequality 

Theorem 18 ([10J Theorem 4) Leta n ^ n and g n be nonnegative sequences of numbers, 
and the following inequality holds: 

^\ — < -InQn + a n g'n + Pn, K > 0, < h n J n < 1, (103) 

•hi 

or, equivalently, 

9n+i < 5n(l - Kin) + ct n h n g v n + h n (3 n , h n >0, < h n ^f n < 1. (104) 

7/ £/tere is a monotonically growing sequence of positive numbers 0«n)$£Li> swc/i £/tcrf t/ie 
following conditions hold: 



— + /3n < 7n 7 



then 

1 

/'» 

Therefore, if linin^oo \i n = oo, i/ten linin^oo^n = 0. 







1 


< 












< 


1 


go 








Mo 


o < 


fjn 


< 



(105) 
(106) 

(107) 



3 Auxiliary results 

3.1 Auxiliary results from the theory of monotone operators 

Recall the following result (see e.g. [13l p. 112]): 

Lemma 19 Assume that equation ([1]) is solvable, y is its minimal-norm solution, as- 
sumption ([2]) holds, and F is continuous. Then 

hm\\V a -y\\=0, (108) 
where V a := Vo >a solves equation (fT0|) with 6 = 0. 
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3.2 Auxiliary results for the regularized equation 

Lemma 20 (|9j Lemma 2) Assume \\F(0) — fs\\ > 0. Let a > 0, and F be monotone. 
Denote 

^(a) := \\V S J, 0(a) := a^(a) = \\F(V s , a ) - f s \\, 

where V$^ a solves (jlOp . Then ip{a) is decreasing, and 4>(a) is increasing (in the strict 
sense). 

Lemma 21 (|9j Lemma 3) If F is monotone and continuous, then \\Vs, a \\ = O(-) as 
a —>■ co, and 

lim \\F(V 6 , a ) - f s \\ = ||F(0)-/ 5 ||. (109) 

Lemma 22 ([9j Lemma 4) Let C > and 7 £ (0,1] be constants such that Co 7 > 
5. Suppose that ||.F(0) — fg\\ > Co 7 . Then, there exists a unique a(5) > such that 

\\F(v SMS ))-fs\\ = csy. 

Lemma 23 If F is monotone then 

max( \\F(u s ) - F(V s )\\,a\\u - v\\ ) < \\F(u) - F(v) + a(u - v)\\, \/u,v € H. (110) 



Proof. Denote 

w := F(u) - F(v) + a(u - v), h := \\w\\. (Ill) 
Since (F(u) — F(v), u — v) > 0, one obtains from two equations 

(w, u-v) = (F(u) - F(v) + a(u -v),u-v), (112) 

and 

(w,F(u) - F(v)) = \\F(u) - F(v)\\ 2 + a(u - v, F{u) - F(v)), (113) 
the following two inequalities: 

a\\u — v\\ 2 < (v,u — v) < \\u — v\\h, (H4) 

and 

\\F{u) - F(v)\\ 2 < (v, F{u) - F(v)) < h\\F(u) - F(v)\\. (115) 
Inequalities f)114|) and ()115p imply: 

a\\u-v\\<h, \\F(u) -F(v)\\ < h. (116) 
Lemma [23] is proved. □ 
Lemma 24 Let to satisfy 

' Oi. (H7) 



a{to) C-l 
Then, 

\\F(u(t )) - f 5 \\ < C8, (118) 

and 

<— IMlfl + T^T Y Vi < i - (H9) 



a """V C-l 
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Proof. This to exists and is unique since a(t) > monotonically decays to as t —* oo. 
Since a(t) > monotonically decays, one has: 

<77^tIMI> 0<t<t . (120) 



a(t) ~ C - 1 
By Lemma [22] there exists t\ such that 

\\F(V 5 (h)) - f 5 \\ =C6, F(V s (t 1 ))+a(t 1 )Vs(t 1 )-f s = 0. (121) 

We claim that ti 6 [0, to] . 

Indeed, from (|12ip and (|137p one gets 

CS = a(t 1 )\\V s (t 1 )\\<a(t 1 )(^\\y\\ + -^\ = a{t x )\\y\\ + 5, C> 1, 

so 

5< 



C- 1 
Thus, 

5 < Hull 



a(ti) ~ C -I a(t ) 

Since a(t) \ 0, one has t\ < to- 
Differentiating both sides of (|21j) with respect to t, one obtains 

This and the relations 

A a := F'(u) + al, F'{u) := A > 0, 

imply 

||v*|| < loip^j^n < ^H^ll < ^(lbll + £) < + c~i)' w - to ' (122) 

Lemma [Ml is proved. □ 
Lemma 25 Let no satisfy the inequality: 

-^—>-^—\\y\\>^-, C>1. (123) 

Then, 

\\F(u no +i) - Ml < CS, (124) 

< IMI f 1 + 7tV)> (125) 



c-iy' 

and 

\\V n - V n+1 \\ < an ~ Qn+1 \\y\ \(l + V„ 1 »„ ! I. (12G) 



V C — 1 / ' 
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Proof. One has a ctn i < 2, Vn > 0. This and inequality (|123p imply 

2 ., „ 25 5 1 , „ S „ . . 

y\\ > — > > 7T— rIMI > — , C > l. (127) 



C — 1 a n[) CL-no + l C — 1 

Thus, 



2 )y\\ > — , Vn < no + 1. (128) 



C-l""" a, 

The number no, satisfying (|123p . exists and is unique since a n > monotonically decays 
to as n — > oo. By Lemma [22j there exists a number ni such that 

||F(K 1+1 ) - < C6 < \\F(V ni ) - M|, (129) 

where solves the equation F(V n ) + a n K — fs = 0. VFe c/aim i/iai ni G [0, no]. Indeed, 
one has \\F(V ni ) - f 5 \\ =a ni ||K ll ||, and ||KJ < M + 7T~ ( cf - C3ZD), so 

CS<a ni \\V ni \\<a ni (\\y\\ + — )=a ni \\y\\ + 6, C > 1. (130) 

Therefore, 

«5<^M. (131) 

Thus, by (fT30|) . 

— < tPt < — ■ (132) 

Here the last inequality is a consequence of (|130p . Since a n decreases monotonically, 
inequality (|132p implies n\ < no- This and Lemma [20l implies 

||FK 0+1 ) - f s \\ < \\F(u ni+1 ) - f s \\ < CS. (133) 

One has 

an+i||K - K+i|| 2 = ((a n +i - a n )V n - F(V n ) + F(V n+l ),V n - K+i) 

< {(a n+l - a n )V n ,V n - K+i) (134) 

< (a„ - an+i)||^||||K - V n+ x\\. 

By (fT37j) . \\V n \\ < \\y\\ + £, and, by {EE}, £ < *| for all n < n + 1. This implies 
(fT25j) . Therefore, 

||K - K+i || < ^ - an+1 \\VJ < an ~ Qn+1 \\v\\ (l + -^—) , Vn<n + 1. (135) 

Lemma [25] is proved. □ 

Lemma 26 Lei := a 1 5=0 j so F(V a ) + aV — / = 0. Let y be the minimal-norm 
solution to equation ([I]). Then 

\\Vs,a-V a \\<-, \\V a \\ < \\y\\, a>0, (136) 
a 

and 

5 5 

\\Vs, a \\ < \\V a \\ + - < \\y\\ + -, a>0. (137) 
a a 
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Proof. ^From one gets 

F(V S>a ) - F(V a ) + a(V S , a - V a ) = f - f S . 

Multiply this equality by {V$^ a — V a ) and use ([2]) to obtain 

5\\V 5 , a -V a \\ > (f-fs,V S ,a-V a ) 

= {F(y S>a ) - F(V a ) + a(Vs, a ~ V a ), V S , a - V a )) 

>a\\V s , a -V a \\ 2 . 

This implies the first inequality in (|136p . 

Let us derive a uniform with respect to a bound on ||V^||. From the equation 

F(V a ) + aV a - F(y) = 0, 

and the monotonicity of F one gets 

= (F(V a ) + aV a - F(y),V a - y) > a(V a , V a - y). 

This implies the desired bound: 

\\V a \\ < \\y\\, Va>0. (138) 

Similar arguments one can find in |13|, p. 113]. 

Inequalities (1137|) follow from (|136p and (|138p and the triangle inequality. 

Lemma [26] is proved. □ 

Lemma 27 ([6] Lemma 2.11) Let a(t) = j^^e where d,c,b > 0, c > 6b. One has 

f\i\a{s)\\\V 5 (s)\\ds<la(t)\\V s (t)l t > 0. (139) 



Jo * 
Lemma 28 ([7J Lemma 9) Let a(t) = where b 6 (0, ±], d 2 c 1 - 2b > 66. Define 

= \ Jo ^~^ds. Then, one has 

e - v (t) e ^)\a( s )\\\V s (s)\\ds < la(t)\\Vs(t)\\. (140) 



Jo * 
Lemma 29 (g] Lemma 9) Leta(t) = where b € (0, \], dc 1 ^ > 66. Define ip(t) 

\ Jo ^2~^ s - Then, one has 

r-t 



e~*® I e^\a(s)\\\Vs(s)\\ds < |«(t) || ^ (t) || . (141) 
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Remark 8 In theorems [TT1 - I15I we choose uq € H such that 

II uii < 

5o := «o - Vq\\ < . (142) 

a 

It is easy to choose uq satisfying this condition. Indeed, if, for example, uq = 0, then by 
Lemma [20] one gets 

iiT/ ii Q oll^oll ^ TO -Ml n ^ 

50 = Vo = < • ( 14 3) 

oo a 



If ([HID and either ([58} or ([85]) hold then 



go < ^. (144) 



This inequality is used in the proof of Theorem [TT] and [15] 
If (PZZD and (U2} hold, then 

50 < |- (145) 
This inequality is used in the proof of Theorem [T3] 

4 Proofs of the basic results 

4.1 Proofs of the Discrepancy Principles 
4.1.1 Proof of Theorem [1] 

Proof. [Proof of Theorem[TJ The existence and uniqueness of a(5) follow from Lemmal22l 
Let us show that 

lim a(S) = 0. (146) 
5^0 

The triangle inequality, the first inequality in (|136|) . equality ([TT]) and equality ([TO]) imply 

a(S)\\V a (S)\\ < a(S)(\\V SAS) - V a{s) \\ + \\V SAS )\\) 
<5 + a(S)\\V 5A s)\\ =6 + CP. 



i,From inequality (|147p . one gets 



lima(6)\\V a[s) \\=0. (148) 



It follows from Lemma [201 with fg = f, i.e., 5 = 0, that the function (j>o(a) '■= o,\\V a \\ is 
nonnegative and strictly increasing on (0, oo). This and relation (|148p imply: 

lim a(S) = 0. (149) 
5^0 

^From (TTT]) and ()137|) . one gets 

CP = a\\V s J\ <a(S)\\y\\+S. (150) 
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Thus, one gets: 

C5^ - 5 < a(5)\\y\\. (151) 
If 7 < 1 then C — 5 1 ~~ t > for sufficiently small 5. This implies: 

5 S^WvW 
< lim — — < lim = 0. (152) 

By the triangle inequality and the first inequality (11361) , one has 

Ws,a{S) - V\\ < \\ V a(S) ~ V\\ + \\K(5) - V S)a ( S )\\ < \\V a (g) - y\\ + ^r. (153) 

Relation (fTJ) follows from ([152]) . (fT53"j) and Lemma [H □ 

4.1.2 Proof of Theorem [3] 

Proof. [Proof of Theorem [3] By Lemma [23] 

- v\\ < \\F(u) - F(v) + au - av\\, Vv,u£H, Va > 0. (154) 

Using inequality (|154|) with u = and u = V§ ;0l rg\, equation with a = a(S), and 
inequality (fTBj) . one gets 



«Wlb<5 - K5,a(<T)ll < 11^(^5 ) - ^C^,a(5)) + a(5)v S ~ a(5)Vs, a (S)\ 

= \\F(vs) + a{5)v s -fs\\<eS. 



(155) 



Therefore, 

65 

\\V6-V SMS) \\ <^y. (156) 

Using (|137p and (|156p . one gets: 

a(<S)NI| <a(5)||^, a ( 5 )||+a^)|b5-n, a((5) || < 0<5 + + 5. (157) 

^From the triangle inequality and inequalities (|18p and (|19p one obtains: 

a(S)\\vs\\ > \\F(v s ) - M| - + a(5)v 5 - fs\\ > CtP - 65. (158) 

Inequalities (|157|) and (|158|) imply 

Ci<F-0$<0<$ + a(<y)||y|| +<5. (159) 

This inequality and the fact that C\ — 5 l ~" i — 265 1 ~' y > for sufficiently small 5 and 
< 7 < 1 imply 

^ c-jC-V-. - 0<6<<L (160) 

Thus, one obtains 

lim — — = 0. (161) 

<5^o a(6) 
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^From the triangle inequality and inequalities (|18p. (|19p and (|156p . one gets 

a(.S)\\V S ,a(S)W ^ W F M ~ Ml + II^M + " Ml + - V &M&) \ 

< C 2 P + 65 + 65. 



This inequality implies 



lima(5)\\Vs M5) \\=0. (162) 



The triangle inequality and inequality (|136p imply 



(163) 
< S + a\\V 5 ,a\\. 

^From formulas (|163p and (|162p . one gets 

lim a(5) \\V a{S ) II = 0. (164) 

It follows from Lemma [20l with fg = f, i.e., 5 = 0, that the function (f>o(a) := o||V^|| is 
nonnegative and strictly increasing on (0, oo). This and relation (|164p imply 

lim a(5) = 0. (165) 
^From the triangle inequality and inequalities (|156p and (|136p one obtains 

IK - V\\ < hs ~ Vs,a(6) II + \\Vs, a {S) ~ V a{5) II + Wa(S) ~ V\\ 

M 6 I I T 7" , ( l66 ) 

< — TTs + —TFT + PW) - y , 

a (a) a(dj ^ ; 

where V a (s) solves equation (3) with a = a(5) and f$ = f. 

The conclusion (120p follows from inequalities (116ip . (|165p . (|166p and Lemma [T9l The- 
orem [3] is proved. □ 

4.2 Proofs of convergence of the Dynamical Systems Method 
4.2.1 Proof of Theorem [5] 
Proof. [Proof of Theorem [5] Denote 

C := *±±. (167) 

Let 

w := us - Vs, g(t) := \\w\\. (168) 

One has 



w = -V s - A£ t) [F(u 5 ) - F(V S ) + a(t)w] . (169) 
We use Taylor's formula and get: 

Mo n 

F(u 5 ) - F(V S ) + aw = A a w + K, \\K\\ < ^-\\w\\ 2 , (170) 
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where K := F(ug) — F(Vs) — Aw, and M2 is the constant from the estimate (|24p and 
A a := A + al. Multiplying (|169p by w and using (|170p one gets 

gg < -g 2 + ^II^Hs 3 + \\V 5 \\g. (171) 
Let to be defined as follows 

6 1 „ „ 



a(*o) C " 1 



C > 1. (172) 



This and Lemma [24] imply that inequalities (jll8|) and (jll9|) hold. Since g > 0, inequalities 
(fTTTD and (fTT9l) imply, for all t £ [0,t ], that 

en 9 |a| M9 „ / 1 \ . , 

^--^ + w/ + W) Cu " = Ci = M { 1+ c=i} (173) 

Inequality (fT73|) is of the type ([MI) with 

7(*) = 1, «(t) = ^-, (3(t) = cA. (174) 
Let us check assumptions (|99l) - (|10ip . Take 

Kt) = 4y (175) 

where A = const > and satisfies conditions (|25p - (|28p in Lemma [H It follows that 
inequalities ([99]) - (|10ip hold. Since uq satisfies the first inequality in ([29]) . one gets g(0) < 
by Remark El This, inequalities (pl) - (fT0T|) . and Corollary Q7] yield 

g(t)<^-, Vt<t , g(t):=\\u s (t)-Vs(t)\\. (176) 

Therefore, 

\\F(u 5 (t)) - M| <\\F(u 5 (t)) - F(V s (t))\\ + \\F(V s (t)) - f,\\ 



<M ig (t) + \\F(V 5 (t))-fs\\ 

<^j^ + \\F(Vs(t))-fs\\, Vt<t . 



(177) 



^,From ()172p and Lemma I24"! one gets 

\\F(V s (t )) - Ml < WFiVsih)) - M| = C5. (178) 

This, inequality (|177p . the inequality < \\y\\ (see ([25]) ). the relation ()117p . and the 
definition C x = 2C - 1 (see (fToTD ). imply 

P"Mfo)) - /,|| <^^ + C5 

< M i ^-l) +c ^ ^_ ( 179 ) 
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Thus, if 

\\F(u s (0)) - M| > dP, < 7 < 1, (180) 

then, by the continuity of the function t — > \\F(us(t))—fs\\ on [0, oo), there exists tg € (0, to) 
such that 

\\F(u s (t 5 )) - M| = C X V (181) 

for any given 7 G (0,1], and any fixed Cx > 1. 
Lei us prove (f3~Tj) . 

^,From (|177p with t = t$, and from (|137p . one gets 



Ci^<Mi^ + o(ti)||^(ti)|| 
<M 1 ^M + ||y||a(t 5 ) + 5. 



where C < C\ is a constant. Therefore, 

lim — — r < lim — =— . 

5^0 a(ts) s^o C \ ^ 



We claim that 



hh = -h 2 + (v, a(u$ - Vg)) + a(v, Vg) 

< -h 2 + h\a\\\u s - V s \\ + \a\h\\V s \\, h>0. 



(182) 



Thus, for sufficiently small 5, one gets 

C& <a{t s )(^Y + \\y\\\, d>0, (183) 



lim — — < lim ^-JifMl. + \\y\\ ) = 0, < C < 1. (184) 



lim tg = 00. (185) 



Let us prove (|185p . Using ([23]) . one obtains: 

^(F(ug) + au 5 - f s ) = A a u 5 + dug = -(F(u 5 ) + aus - fs) + aug. (186) 



This and (|2ip imply: 

j t [F(u 5 ) - F(Vg) + a(u 5 - V 5 )} = - [F{ug) - F(Vg) + a{u 5 - Vg)] + au s . (187) 
Denote 

v : = v (t) := F(ug(t)) - F(Vg(t)) + a(t)(ug(t) - Vg(t)), h := h(t) := ||v||. (188) 
Multiplying (|187p by v, one obtains 



(189) 



Thus, 

h < -h + \a\\\ug-Vg\\ + \a\\\Vg\\. (190) 
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Note that from inequality (|197p one has 

a\\u s -V 5 \\<h, \\F(u 6 )-F(V s )\\<h. 
Inequalities (|19U|) and (|19ip imply 

h<-7»^l-M^+|d|||^||. 
Since 1 — ^ > 5 because c > 26, inequality (I192p holds if 

fc<-~/i+|a|||^||. 

Inequality (|193p implies: 

t t r l s 

h{t) </i(0)e~2 +e~2 e*\a\\\V s \\ds. 
Jo 

/From CEMD and ([197]), one gets 

\\F(us(t))-F(V s (t))\\<h(0)e-*+e-v [ e*\a\\\V s \\ds. 

Therefore, 







\F(u s (t)) - f s \\ > \\F(V 5 (t)) - M| - ||iW)) - F(u 8 (t))\\ 
> a(t)\\V 5 (t)\\ -^(0)e-3 -e-3 / e§ |d| 







^From Lemma [27] it follows that there exists an a(i) such that 



\a{t)\\V 8 {t)\\>e-l f\i\a\\\V & {s)\\ds. 
For example, one can choose 

d_ 

(cTtf 

where d,c,b > 0. Moreover, one can always choose uq such that 



"(^TTTS' 66 <c, 



fc(0) = ||F(«o) + o(0)«o " fs\\ < \a(0)\\V s (0)\\, 
because the equation F(uo) + a(0)uo — f$ = is solvable. If (|199p holds, then 

fc( ) e -| < ia(0)||F a (0)||e-t, i > 0. 
If 26 < c, then (fT98l) implies 

e~^a(0) < a(i). 
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Therefore, 

e-h(0) < ^o(t)||^(0)|| < ±a(t)\\V s (t)\\, t > 0, (201) 

where we have used the inequality < ||^(i')ll f° r t < t' -> established in Lemma 1201 

/.From (fT8T1) and (fT85l) - pnT1) . one gets 

dtf = \\F(u s (t s )) - f 5 \\ > ^a(t s )\\V s (ts)\\. (202) 

Thus, 

lima(*j) II Vs(ts)\\ < lim4Ci<5 c = 0. (203) 

Since ||K5(i)|| increases (see Lemma [20]) . the above formula implies lim^o = 0- Since 
< a(t) \ 0, it follows that lim^o^ = °°; i- e -> ([IB5D holds. 
It is now easy to finish the proof of the Theorem 

^From the triangle inequality and inequalities (1176P and (|136j) one obtains 
\\u s (t 5 ) - y\\ < \\u 5 (t s ) -V 5 \\ + \\V{t 5 ) - Vs(t s )\\ + \\V{t s ) - y\\ 

A a[ts) 

Note that V(t) := Vs(t)\$ =0 and V$(t) solves (|2"Ij). Note that ^(tj) = Vo (0 (tj) (see equation 
^From (HSU, (gBSD , inequality (1203|) and Lemma H5J one obtains dSTJ. Theorem [5] 
is proved. □ 

Remark 9 The trajectory ug(t) remains in the ball B{uq,R) := {u : \\u — uq\\ < R} for 
all t < t$, where R does not depend on 5 as 5 — ► 0. Indeed, estimates (|176|) . f|13T|) and 
(HUD imply: 

- «o|| < IM*) " V s (t)\\ + \\V s {t)\\ + ||uo|| 

o(0) C||y|| (205) 
< — ^- + g _ l + |KH := R, Vt<t s . 

Here we have used the fact that tg < to ( see Lemma [Ml- Since one can choose a(t) and 
A so that is uniformly bounded as 6 — > and regardless of the growth of M\ (see 
Remark [7]) one concludes that R can be chosen independent of 5 and M\. 

4.2.2 Proof of Theorem 
Proof. [Proof of Theorem [7] Denote 

C := ^±1. (206) 

Let 

w:=us-V s , g(t) := \\w\\. (207) 

One has 

\t)\ 



w = -V s - A* a(t) [F(u s ) - F(V S ) + a(t)w] . (208) 
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We use Taylor's formula and get: 



F(u s ) - F{V 5 ) + aw = A a w + K, \\K\\ < ^\\w\\ 2 , (209) 

where K := F(ug) — F(Vs) — Aw, and M2 is the constant from the estimate (|24p and 
A a := A + al. Multiplying (12080 by w and using (j209H one gets 

99 < -oV + M2( ^ + a) g 3 + \\V s \\g, g := g(t) := \\w(t)\l (210) 

where the estimates: (A*A a w, w) > a 2 g 2 and ||-A a || < Mi + a were used. Note that the 
inequality (A* a A a w, w) > a 2 g 2 is true if A > 0. Since i 7 is monotone and differentiable 
(see ©), one has A := F'(u 5 ) > 0. 
Let to > be such that 

C>1, (211) 



a(t ) C-l l|yn ' 

as in (|117p . It follows from Lemma [23] that inequalities (|118p and (|119p hold. 
Since <? > 0, inequalities (|210p and (|119p imply, for all t G [0,£o]> that 

9(t) < -a 2 (t) 9 (t)+c (M 1 +a(t))< 7 2 (t) + ^||lci, c = ci = ||y|| M +^-L_) . (212) 

Inequality (l2T2|) is of the type ((Ml) with 

1 (t)=a 2 (t), a(t) = c (M 1 + a(t)), f3(t) = Cl ^. (213) 

Let us check assumptions ([99~|) - (|10ip . Take 

= ITT, A = const. (214) 
a 2 (t) 

By LemmaH there exist A and a(t) such that conditions ()35p - (|39p hold. This implies that 
inequalities (|9^ - (fT0Tj) hold. Thus, Corollary [IT] yields 

9(t)<^, W<t . (215) 
Note that inequality (|215p holds for t = since (|39p holds. Therefore, 

\\F(u s (t)) - f s \\ <\\F(u 5 (t)) - F(V 5 (t))\\ + \\F(V s (t)) - Ml 

<M ig (t) + \\F(V 5 (t))-f 5 \\ (216) 

<^^ + \\F(Vs(t))-f s \l \ft<t . 

It follows from Lemma 1201 that ||F(V5(t)) — Ml is decreasing. Since t\ < to, one gets 

\\F(V s (t )) - M| < \\F(V 5 (h)) - M| = C*. (217) 
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This, inequality (|216p . the inequality < \\y\\ (see ([36]) ). the relation (|21ip . and the 
definition C x = 2C - 1 (see (12061) ) imply 

ll^(td))-/*||<^^)+C5 

< M ^- 1 KC5<(2C-1)5 = C 1 S. (218) 



We have used the inequality 



a 2 (to) < a(t ) = 6{C . „ 1] (219) 

\\y\\ 



which is true if 8 is sufficiently small, or, equivalently, if to is sufficiently large. Thus, if 

lin^(O)) - Ml > Cx6<, 0<C< 1, (220) 
then there exists t$ € (0, to) such that 

\\F(u s (t s )) - f s \\ = C^ (221) 



for any given ( £ (0, 1], and any fixed C\ > 1. 

Let us prove (Jl2j) . // this is done, then Theorem [?] is proved. 

First, we prove that lim^^o ^f^y = 0- 

^From (12T6|) with t = t s , ^3TJ and (TT37|) . one gets 



Ci^ <Mx^M + a (t 5 )||y 6 fo)|| 
< Ml ^M + ||y||a(t (5 )+5. 



Thus, for sufficiently small S, one gets 



where C < C\ is a constant. Therefore, 



5->o a(ts) 5^0 C \ A 
Secondly, we prove that 



Using (|33|) . one obtains: 



(222) 



C5<<a(t 5 )^fl + \\y\^, C> 0, (223) 



lim-^<limCif^^ + |H|)=0, 0<C<1. 122!! 



limt 5 = oo. (225) 
<5^0 



(F(u s ) + auj - f s ) = A a u 5 + d-uj = -A a A* a (F(u s ) + au<5 - f s ) + au s . (226) 
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This and (|2ip imply: 
d 



[F(u s ) - F(V 8 ) + a(u 5 - V S )] = -A a A* a [F(u s ) - F{V 5 ) + a(u 6 - V s )] + au 5 . (227) 



dt 
Denote 

v:=F(us)-F(Vs) + a(us-V s ), h := h(t) := \\v(t)\\. (228) 
Multiplying (|227p by v and using monotonicity of F, one obtains 

hh = — (A a A* a v, v) + («, d(u 5 -V s ))+a{v, V s ) 

o o (229) 
< -h 2 a 2 + /i|d|||u 5 - V s \\ + |d|/i||V^||, d > 0. 

Again, we have used the inequality A a A* > a 2 , which holds for A > 0, i.e., monotone 
operators F. Thus, 

h < -ha 2 + \a\\\u s - V s \\ + \a\\\V s \\. (230) 
^From inequality (jllOp we have 

a||u*-^|| </», \\F(us)-F(V s )\\<h. (231) 

Inequalities (I230p and (|23ip imply 

d< "^(a 2 -^) + NIW ( 232 ) 

Since a 2 - ^ > ^ > ^ by inequality ([35]), it follows from inequality (|232j) that 

a 2 

d < -yd + |d|||^||. (233) 

Inequality (|233j) implies: 

/i(t) < ^Oje-JS^ + e-^* /" eJ"o*^*|a(a)|||Vi(a)||d«. (234) 

JO 

Denote 

/From (12341) and (|23"TD . one gets 

||F(n 5 (t)) -F(V*(t))ll < /»(0)e-^W + e"^ f e^|d( S )|||F a ( S )||d S . (235) 

JO 

Therefore, 

- Ml > - Ml - - HMt))\\ 

>a(t)\\V s (t)\\-h(0)e-^ -e~v® f e^\a\\\V 5 \\ds. 
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^From Lemma [28] it follows that there exists an a(t) such that 

\a{t)\\V s {t)\\>e-^ j\^)\a\\\V 5 {s)\\ds. 
For example, one can choose 



(237) 



a ^ = J^tj~ b > be(0,-], c(c^ b >6b, (238) 
where ci, c > 0. Moreover, one can always choose no such that 

MO) = \\F( Uo ) + a(0)u - f s \\ < ~a(0)\\Vs{0)\\, (239) 

because the equation 

F(uq) + a(0)n - fs = (240) 

is solvable. 

If (p39|) holds, then 

/i(0)e^ (t) < io(0)||^(0)||e-^*), t > 0. (241) 

If (|238l) holds, c > 1 and 2b < cf , then it follows that 

e^ (t) a(0) < a(t). (242) 

Indeed, inequality a(0) < a(t)e^^ is obviously true for t = 0, and (a(t)e^*)). > 0, 
provided that c > 1 and 2b < c\. 

Inequalities (124TD and (ggSD imply 

e^W^O) < ±a(t)||V,(0)|| < Ja(t)[|Vi(<)ll, * > 0- (243) 

where we have used the inequality ||Vft(£)|| < ||V^(i')|| for t < t', established in Lemma l20l 
/From (I22T1) and (|225 j> -(|SB j> . one gets 

C<5« = ||F(ui(t,)) - M| > ^a(ti)||^(t 4 )||. (244) 

Thus, 

lim a(ts)\\V 5 (t s )\\ < lim 4C<5 f = 0. (245) 

Since ||V^(t)|| is increasing, this implies lim<5_>o a(ts) = 0. Since < a{t) \ 0, it follows 
that ([255]) holds. 

^From the triangle inequality and inequalities (I215P and (|136j) one obtains 
IM**) - 2/11 < \\us(t s ) -V s \\ + \\V(t s ) - V s (ts)\\ + \\V(t s ) - 2/|| 

where V(t) := V^(t)| <5=0 and V s (t) solves ([11]). /From ([223jl . (12251) . inequality (p36l) and 
Lemma [T9l one obtains (|42p . Theorem [7] is proved. □ 

By the arguments, similar to the ones in the proof of Theorem I11H15I or in Remark [9] 
one can show that the trajectory ug(t) remains in the ball B(uq, R) := {u : \\u — uo\\ < R} 
for all t < ts, where R does not depend on 5 as 5 — > 0. 
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4.2.3 Proof of Theorem M 
Proof. [Proof of Theorem [S] Denote 

C := *±1. (247) 

Let 

w:=us-V s , g : = g(t) := \\w{t)\\. (248) 

One has 

w = -V s - [F(u s ) - F(V S ) + a(t)w] . (249) 
Multiplying (|249j) by w and using (JS} one gets 

99 < ~ag 2 + \\V s \\g. (250) 

Let to > be such that 

5 1 



a(*o) C - 1 



C > 1. (251) 



This to exists and is unique since a(t) > monotonically decays to as t — » oo. It follows 
from inequality (|25ip and Lemma [241 that inequalities (|118p and (|119p hold. 
Since <? > 0, inequalities (|250p and (|119p imply 

g < - a (t) 3 (t) + Mi Cl , Cl = || y ||fl + _1 T Y (252) 



a(t) A ' 1 " y "V C- 1 
Inequality (l252|) is of the type |31) with 

7 (t) = a(t), a(t) = 0, ^)=A (253) 

a(t) 

Let us check assumptions (I99l - (I101I) . Take 

a(t) = A = const. (254) 

a(t) 

By Lemma [8] there exist A and a(t) such that conditions (I47p - (|50p hold. It follows that 
inequalities (l99l) - (fTQll hold. Thus, Corollary Q7] yields 

g(t)<^, Vt<t - (255) 



Therefore, 



\F(u s (t)) - M| <||F(«,(f)) - F(V,(t))|| + ||F(V,(t)) - Ml 

<M l5 (t) + ||F(F a (t))-M| (25g) 

<^^- + \\F(V s (t))-fs\\, Vt<t - 
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It follows from Lemma 1201 that ||F(V^(t)) — fs\\ is decreasing. Since t\ < to, one gets 

\\F(V s (to)) ~ Ml < " Ml = CS. (257) 

This, inequality (|256p . the inequality ^ < ||y|| (see (|17|) ). the relation (|25ip . and the 
definition C\ = 2C - 1 (see (gUP ) imply 



\\F(u s (t ))-m<^^ + C5 



< Ml f- 1 hc5<(2C-l)5 = C 1 5. 

M\y\\ 



Cl 5< < M 1 ^- + a(t s )\\Vs(t s )\\ 
< Ml ^ + \\y\\a(t s ) + S. 



where C < C\ is a constant. Therefore, 



(258) 



Thus, if 

\\F(u s (0)) - M| > dtf, 0<C< 1, (259) 
then there exists tg € (0, to) such that 

\\F(u 5 (ts)) - fs\\ = (260) 

for any given ( £ (0,1], and any fixed C\ > 1. 

Let us prove (|53|) • -tf £fes *s done, i/ien Theorem is proved. 

First, we prove that lim^o = 0. 

^From ()256p with t = t$, and from (|137p . one gets 



(261) 



Thus, for sufficiently small 5, one gets 

C#<a(ts)(^y + \\v\\\, C> 0, (262) 



5 l ' < / Mi , , , 

lim — — < hm — =- — - + \\y\\ = 0, < ( < 1. (263) 



5^0 a(tg) 5->o C U 
Secondly, we prove that 

lim^ = oo. (264) 
8->0 

Using (|44p . one obtains: 

^(F(u s ) + ai^ - / 5 ) = A a u s + au 5 = -A a (F(u s ) + au s - f s ) + au s , (265) 

where ^4 a := F'(itg) + a. This and (|2ip imply: 
d 



dt 



[F(u 5 ) - F(Va) + a(n 5 - V s )] = -A a [F(u s ) - F(V S ) + a(u 5 - V s )] + au 5 . (266) 
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Denote 

v:=F(us)-F(Vs)+a{u 5 -V 5 ), h = \\v\\. (267) 
Multiplying (|266p by v and using monotonicity of F, one obtains 



hh = -(A a v,v) + (v,a(us - Vs)) +a(v,V s ) , 
_ (zoo) 
< -h 2 a + /i|d|||ua - V s \\ + |d|/i||Va||, ft > 



Again, we have used the inequality (F r (u$)v,v) > which follows from the monotonicity 
of F. Thus, 

h < -ha+ \a\\\u s - V s \\ + \a\\\V s \\. (269) 
Inequalities (|269p and (|276p imply 

h < -h(a - ^ + \a\\\V 5 \\. (270) 

Since a — ^ > | by inequality (06]) , it follows from inequality (|270|) that 

ft < -|^ + |d|||^||. (271) 

Inequality (|27ip implies: 

h(t) < ft(0)e~ $ ^ ds + e~ J? / e-/o 2 ^|d(s)|||F 5 (s)||ds. (272) 

•/ o 

Denote 

¥>(«) := jT (273) 

/From (12721) and (l276|) . one gets 

\\F(u 5 (t)) - F(V 6 (t))\\ < h(0)e-e® + e-*® f e^\a(s) \ \\V s (s)\\ds. (274) 



o 



Therefore, 

II^M*)) - Ml > - Ml - \\F(V s (t)) - F(u 5 (t))\\ 

> a(t)\\V 5 (t)\\ - h^e-oW - e-*-W f e^\h\\\V 5 \\ds. 



2 

For example, one can choose 



(275) 



From Lemma [29] it follows that there exists an a(t) such that 

a(t)\\V s (t)\\ > e-vO I* e"M\a\\\V s (s)\\d8. (276) 
Jo 



a ^=(^p & e(0,i], dc 1 - b > 66, (277) 
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where d, c > 0. Moreover, one can always choose uq such that 

h(0) = \\F(u ) + a(0)u - f S \\ < ia(0)||^(0)||, (278) 

because the equation 

F(u ) + a(0)u - f s = (279) 

is uniquely solvable for any fg & H ii a(0) > and F is monotone. 
If (12781) holds, then 

h(0)e-*® < io(0)||^(0)||e-^*), t > 0. (280) 

If (gTZD holds, c > 1 and 26 < d, then it follows that 

e^ (t) a(0) < a(t). (281) 

Indeed, inequality a(0) < a(t)e v ^ is obviously true for i = 0, and (a^e 1 ^)^ > 0, 
provided that c > 1 and 26 < d 

Inequalities (12801) and (gEEJ) imply 

e^^O) < la(t)\\V s (0)\\ < la(t)\\V 6 (t)\\, t > 0, (282) 

where we have used the inequality ||V#(i)|| < ||V^(i')|| for t < t', established in Lemma [20l 
/From p60l) and (|264l) - (|282l) . one gets 

C6< = \\F(us(t s )) - fs\\ > \a(t s )\\Vs(t s )\\. (283) 

Thus, 

lim a(t s ) II Vstis) II < lim 4C5 C = 0. (284) 

Since ||V^(t)|| is increasing, this implies lim^o a,(tg) = 0. Since < a{t) \ 0, it follows 
that ([251D holds. 

^From the triangle inequality and inequalities (|255p and f| 136|) one obtains: 

Nfo) - 2/|| < -V&W + \\V(t 5 ) - V s {t s )\\ + \\V(t s ) - 2/|| 

<°^), 5 ,\\v(^ ii (285) 
< — p- + -7TT + - y\\, 

A a(ts) 

where V(t) := V s {t)\ 5=0 and V^(t) solves flU). /.From (12631) . (l264j) . inequality (12851) and 
Lemma 1T9~1 one obtains (|53[) . Theorem [9] is proved. □ 

By the arguments, similar to the ones in the proof of Theorem I11H15I or in Remark [91 
one can show that: the trajectory ug(t) remains in the ball B(uq, R) ■= {u : \\u — uq\\ < R} 
for all t <ts, where R does not depend on 5 as 5 — > 0. 
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4.3 Proofs of convergence of the iterative schemes 
4.3.1 Proof of Theorem [UJ 
Proof. [Proof of Theorem [11] Denote 

C := £±i. (286) 

Let 

z n := u n - V n , g n := \\z n \\. (287) 
We use Taylor's formula and get: 

Mo n 

F(u n )-F(V n )+a n z n = A an z n + K n , \\K n \\ < ^\\z n \\ 2 , (288) 

where K n := F(u n ) - F(V n ) - F'(u n)z n and M2 is the constant from (|24[) . ^From (|56H 
and (|288p one obtains 

z n+1 = z n -z n - A- x K{z n ) - (K+i - V n ). (289) 
^From (|289[) . (|288[> . and the estimate || ^4~ x || < ^ one gets 

M90 2 

< + IlK+i - K||- (290) 

2a n 

There exists a unique uq such that 

— > 7^-rllvll > — , C>1. (291) 

It follows from (pZ9"Tj) and Lemma [25] that inequalities ([121]) and (fT2l)j) hold. 
Inequalities ([290]) and (fT26l) imply 

c 2 a„ - a n+ i M 2 .. ., / 2 \ 

5n+i < — ff„H ci, c = — , ci= y 1 + — — - , (292) 

a n a n+ \ 1 \ C - 1 J 

for all n < no + 1. 

Let us show by induction that 

g n < y , < n < n + 1. (293) 

Inequality (|293p holds for n = by Remark [8] (see (j!44p ). Suppose (|293p holds for some 
n > 0. ^From (12921) . (12931) and (JBDJ, one gets 

. Co ( a n \ 2 a n — a n+ \ 
9n+i < — -r H c i 



a n\^J a>n+l 
CQdn o, n — a n+ i ^ (294) 
A 2 a n+ i 



< 
- A 
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Thus, by induction, inequality (|293|) holds for all n in the region < n < uq + 1 

LP 
imply 



^From inequality (|137p one has \\V n \\ < \\y\\ + This and the triangle inequality 



6 

IN - « n < \\uo\\ + \\z n \\ + \\V n \\ < \\u \\ + \\z n \\ + \\y\\ H . (295) 

a n 

Inequalities (|125p . (|293p . and (|295p guarantee that the sequence u n , generated by the 
iterative process (I56p . remains in the ball B(uq,R) for all n < nn + 1, where R < % + 
ll n oll + 1 1 2/ 1| + jf - - This inequality and the estimate (|293p imply that the sequence u n , 
n < no + 1, stays in the ball B(uq, R), where 

„ an ,, C + 1 , 

+ KII + IMI + IMI^ 7r y. (296) 

By Remark [71 one can choose ao and A so that ^ is uniformly bounded as 5 — > even if 
M\(R) — > oo as i? — > oo at an arbitrary fast rate. Thus, the sequence u n stays in the ball 
B(uq, R) for n < nn + 1 when 5 — > 0. An upper bound on i? is given above. It does not 
depend on S as 5 — > 0. 
One has: 

\\F(u n ) - fs\\ <\\F(u n ) - F(V n )\\ + \\F(V n ) - f s \\ 

<M ign +\\F(V n )-f s \\ (297) 

<^ + \\F(V n )-f s \\, Vn<n + 1, 
where ()293|) was used and Mi is the constant from (|24p . By Lemma [25] one gets 

HFC^+i) - M| < C<5. (298) 

^From 0, (I297P . ([298]) . the relation (|29l]) . and the definition C\ = 2C - 1 (see ([286jl \ 
one concludes that 



|F(» M+l )-/ 5 ||<^^d±+C« 



<Mfil +Ci <(!C-l) ( = W . 

A||y|| 



(299) 



Thus, if 

\\F(u )-f 5 \\ >dP, 0< 7 < 1, (300) 
then one concludes from (|299p f/mi iaere exists rig, < n$ < no + 1, swc/i iaai 

||F(u n J-/ 5 || <C X ^< ||FK)-/ a ||, 0<n<n,5, (301) 

/or any given 7 E (0, 1], and any /ixed C\ > 1. 

Let us prove (|Mp . If n > is fixed, then 1^ is a continuous function of fs- Denote 

un = lim us at, (302) 
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where N < oo is a cluster point of ns m , so that there exists a subsequence of ns m , which 
we denote by n m , such that 

lim n m = N. (303) 
/.From (I302p and the continuity of i* 1 , one obtains: 

- /|| = lim \\F(u ns J - f Sm \\ < lim dSl = 0. (304) 

m— »oo m rra^oo 

Thus, is a solution to the equation -F(it) = /, and is proved. 

Let ms prove (|66p assuming that (|65p holds. From (|63p and (|297p with n = — 1, and 
from (|30ip . one gets 

C l5 7 < Ml ^-i + a„ s _i||K,-i|| < Mx^-i + ||y|K_i + 5. (305) 

If < 5 < 1 and 5 is sufficiently small, then 

CP <an t -i(^ + \\y\\), C> 0, (306) 



, A 

where C is a constant. Therefore, by (|306p . 

lim < lim — — < lim ^-J^- ( ^ + llyll ] = 0, < 7 < 1. (307) 
5^0 2a ns Wa nj _! 5^0 C V A 



In particular, for 5 = 6 m , one gets 



li m JUL. = 0. (308) 
^From the triangle inequality, inequalities (|136p and (I293j) . one obtains 

\\u nSm - y\\ < \K Sm - V nSm || + \\v nSm - K, m ,oll + ||K, m) o - y\\ 

< a n Sm 6 m (309) 

Recall that K,o = K n (cf. ([MD and (ETJ)). ^From ([65]), (l3U8]h inequality (|309l) and 
Lemma [191 one obtains (|66p . Theorem 1111 is proved. □ 

4.3.2 Proof of Theorem [13] 
Proof. [Proof of Theorem 113] Denote 

C:=^±l. (310) 

Let 

z n :=u n -V n , g n := \\z n \\. (311) 
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We use Taylor's formula and get: 



Mo 

F(u n )-F(V n ) + a n z n = A n z n + K n , \\K n \\ < -^\\z n \\ 2 , (312) 

where K n := F{u n ) - F(V n ) - F'(u n)z n and M2 is the constant from (|24p . ^From (|68p 
and (I312p one obtains 

z n+1 = z n - a n A* n A n z n - a n A* n K(z n ) - (K+i ~ K)- (313) 

^From (|313p . (|312p . ([70]) . and the estimate \\A n \\ < M\ + a n , one gets 



(314) 



<r 111 4* /i 11 1 UrMM + On) 2 , i. T/ T/ ,, 

3n+l < 5nl|l - On^n^nll H ^ 5„ + IIK+1 ~ V n \\ 

2 a n M 2 (Mi+a n ) 2 
< 5„(1 - a„aj H g n + \\V n+ i - V n \\. 

Since < a n \ 0, for any fixed 5 > there exists no such that 

— > t^-tIMI > — . Ol- (315) 

This and Lemma [25] imply that inequalities (|124j) — (|126j) hold. 
Inequalities (|314p and (|126p imply 

g n +i<{^-a n a 2 n )g n + a n co{Mi + a n )gj l + — — ^±Ici, Vn<n + 1, (316) 

«n+l 

where the constants Co and c\ are defined in (|212p . 
Let us show by induction that 

a 2 

g n < -f , < n < n + 1. (317) 

Inequality (|317p holds for n = by Remark [8] (see (j!45|) ) . Suppose (|317p holds for some 
n > 0. ^From (I3TBT) . (I3T71) and ([75]), one gets 

9n + l < (1 - an^)^ + «nC0(M! + a n ) f ^ ' + ~ — 

A V A ) a n+ i 



a n ( ot n c (Mi +a n ) \ a 2 n a n - a n+i 

Ot n ) + T H c l 



A V A /A On+l 

4 2 

OL n d n CL n CL n Q>n+1 

< jtt- + -T- H c i 

ZA A On+l 

a 2 
< a n+l 



(318) 



A 

Thus, by induction, inequality (|317p holds for all n in the region < n < no + 1. 
^,From (|137p one has ||V^|| < ||y|| + This and the triangle inequality imply 

||% - "nil < IKH + Iknll + \\Vn\\ < ||«o|| + H^nH + IMI H • (319) 
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Inequalities (|125p . (|317p . and (|319j) guarantee that the sequence u n , generated by the 
iterative process (j68|) . remains in the ball B(uq,R) for all n < uq + 1, where R < + 
1 1 iao 1 1 + ||y|| + jf - - This inequality and the estimate (|317p imply that the sequence u n , 
n < no + 1, stays in the ball B(uq, R), where 

a C + 1 , 

R<^ + \\u Q \\ + \\y\\ + \\y\\-^—^. (320) 

By Remark [71 one can choose ao and A so that ^ is uniformly bounded as 5 — > even if 
Mi(R) — ► oo as -R — > oo at an arbitrary fast rate. Thus, the sequence u n stays in the ball 
B{uq, R) for n < no + 1 when 5 — > 0. An upper bound on i? is given above. It does not 
depend on 5 as (5 — > 0. 
One has: 

||-F(«n) - Ml <II^K) - + II^CK) - Ml 

<M ign + \\F(V n )-f s \\ (321) 
<^ + ||F(y n )-M| ; Vn<n + 1, 
where (|317p was used and Mi is the constant from (|24p . By Lemma [25] one gets 

||F(K +l) - Ml < CS. (322) 

/.From ([73]), (132T]) . ([322]) , the relation ([3l5]) . and the definition Ci = 2C - 1 (see (pgQD ), 
one concludes that 



|F(« M+1 )-/ S ||<^^^±l+C« 



< M 1 ^-1) +CT< ^ 

A|y| 



(323) 



17ms, if 

\\F(uq) - M| > Citf, < C < 1, (324) 
then one concludes from (|323|) i/iat t/iere exists rig, < < no + 1, suc/i i/iai 

||FKJ-M| <Ci^< ||F(n n )-M|, 0<n<n 5 , (325) 

/or any given £ £ (0,1], and any /jxed Ci > 1. 
Lei us prove ([75]) . 

If n > is fixed, then U5 jn is a continuous function of Denote 

■u := u N = lim u,? nm . , (326) 

where 

lim n m . = iV. (327) 
^From (j326p and the continuity of F, one obtains: 

\\F(u) - f s \\ = lim \\F{u )- f 5 \\ < HmCi^ = 0. (328) 

J^oo J 0— >U 
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Thus, u is a solution to the equation F(u) = /, and ([75]) is proved. 
Let us prove (|80p assuming that (|79p holds. 
^From (|77|) and (|321|) with n = — 1, and from (|325[) . one gets 

Cl S< < M x ^-i + o^-iH^-ill < M,"^ + \\y\\a ns ^ + S. (329) 
If 5 > is sufficiently small, then the above equation implies 

< an JMp. + c> 0, (330) 



where C < Ci is a constant, and the inequality ajL_i < a ns -\ao was used. Therefore, by 

(EH), 



5 5 , o 1 ^ / Mian ,, , , 
lim < lim < lim — ^- + y =0, < C < 1. (331 



In particular, for 5 = S m , one gets 



lim — = 0. (332) 



^From the triangle inequality and inequalities (|136p and (|317p one obtains 

||«n m - < ||«n m - KJ| + \\V n - VnnflW + ||K m ,0 ~ 2/|| 

a« <5 m llT , , (333) 

Recall that V nfl = V an (cf. ([Ml) and ([21])). ^From ([79]), (1332]) . inequality (1333]) and 
Lemma [T9l one obtains (|80p . Theorem 1131 is proved. □ 

4.3.3 Proof of Theorem H5l 
Proof. Denote 

C := ^±1. (334) 

Let 

z n := u n V^i, <7n := |jz n ||. (335) 

One has 

F(u n ) - F(K) = J„ = / i^o + (336) 

Jo 

Since > 0, Vu e and \\F'(u)\\ < Mi,Vu G B(u ,R), it follows that J„ > and 

H-4H < Mi. ^From flST) and ([331)1) one obtains 

Z n +1 = - Q! n [F(u n ) - F(V n ) + a n Z n ] - (V^+l - V n ) 

= (1 - a n (J n + a n ))z n - (K+i - V^). 
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/From (13371) and (USD, one gets 

9n+\ < 5n||l - a n {Jn + a n )\\ + \\V n+ i - V n \ 
< g n (l - a n a n ) + \\V n+ \ - V n \\. 

Since < a n \ 0, for any fixed 5 > there exists no such that 



(338) 



— > ? ^- r NI>— , C> 1. (339) 
a no+l o — i a no 

This and Lemma [25] imply that inequalities (|124j) — (|126j) hold. 
Inequalities (|338p and ()126p imply 

< (1 - a n a n )g n + — — ^-^ci, Vn<n + 1, (340) 

«n+l 

where the constant c\ is defined in (|252p . 
Let us show by induction that 

g n < y , < n < no + 1. (341) 

Inequality (|34ip holds for n = by Remark [5] (see (|144|) ). Suppose (|34ip holds for some 
n > 0. /.From ([Ml . (IMP and (JHTj), one gets 

ffn+i < (1 - Oi n a n ) — H ci 

A a n+ i 

2 

_ o n a n ^ a n ^ a n — a n _)_i ^ (342) 



< 



A A a n+ i 



Thus, by induction, inequality (|341|) holds for all n in the region < n < no + 1. 
^From (|137p one has ||V^|| < ||y|| + — . This and the triangle inequality imply 

\\uq - u n \\ < \\u \\ + ||z n || + \\V n \\ < \\u \\ + ||z n || + \\y\\ H . (343) 



a 



Inequalities (|125p . (|34ip . and (|343p guarantee that the sequence u n , generated by the 
iterative process (|8ip . remains in the ball B(u$,R) for all n < no + 1, where R < ^ + 
li u o|| + ||y|| + jfr- This inequality and the estimate (|34ip imply that the sequence u n , 
n < no + 1, stays in the ball B(uq, R), where 

„ an C + 1 . 

+ ||«o|| + 112/11 + 112/ll^ry- ( 344 ) 

By Remark [7J one can choose ao and A so that 2& is uniformly bounded as 5 — > even if 
M\{R) — > oo as R — > oo at an arbitrary fast rate. Thus, the sequence u n stays in the ball 
B{uq, R) for n < uq + 1 when 5 — > 0. An upper bound on R is given above. It does not 
depend on S as 5 — > 0. 
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One has: 

H-F(un) " Ml <\\FM ~ F(Vn)\\ + \\F(V n ) - f s \\ 

<M ign + \\F(V n )-f 5 \\ (345) 

<M^lL + \\ F (V n )-fs\\, Vn<n + 1, 

where (|34ip was used and M\ is the constant from (f24"|) . Since ||F(V^) — /<s|| is decreasing, 
by Lemma [20l and n\ < no, one gets 

\\F(V no+1 ) - M| < \\F(V ni+1 ) - f s \\ < CS. (346) 

/.From (USD, QM5D , dMSD , the relation ([339D . and the definition Ci = 2C - 1 (see (13341 ). 
one concludes that 



\F( Uno+1 )-fs\\<^^ + C5 



< M ^; 1 KC5<(2C-1)S = C 1 S. 
a\\v\\ 



(347) 



Thus, if 

\\F(u )-f s \\ >CxS<, < C < 1, (348) 
then one concludes from (|347p that there exists ng, < ng < no + 1, suc/t i/ia£ 

||^(«n 4 ) - Ml <Cl^< ||-F(«n)-/s||, 0<n<n 5 , (349) 

for any given £ £ (0, 1], and any /ized C\ > 1. 
Le£ us 'prove (I90p . 

If n > is fixed, then ii5 in is a continuous function of Denote 

tt := uat = lim n 5) „ m . , (350) 

where 

lim n m . = iV. (351) 
/.From ()350p and the continuity of F, one obtains: 

||F(«)-/i||= lim \\F{u nm .)- f s \\ < lim = 0. (352) 

3^00 J 5— >0 

Thus, n is a solution to the equation F(u) = f, and ([90P is proved. 
Lei us prove (|92|) assuming that (|9ip holds. 

^From (I89p and (j345j) with n = n$ — 1, and from (|349p . one gets 

C 1( $< < Mx^-i + ^-iH^-iH < Afx^i + ||y||a„ 6 _a + 5. (353) 
If 5 > is sufficiently small, then the above equation implies 

CS< < a„ a _/^ + ||jA C> 0, (354) 
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where C < C\ is a constant. Therefore, by 



8 5 , J 1 ^ /Mi 

lim < hm < hm — — — h \\y\ 

8^0 2a ns 8^o a„ 4 _i s^o C \ A 

In particular, for 5 = 6 m , one gets 



o, o<c<i. 



lim 



0. 



^From the triangle inequality, inequalities f)136j) and (|34ip . one obtains 

|K m - 2/ 1 1 < \\Un m ~ V nm \\ + \\V n - V nm! o\\ + ||K m ,0 ~ 2/| 

< — r~ + + K m ,o - 2/ ■ 

A a„_ 



(355) 



(356) 



(357) 



Recall that V nfi = V an (cf. ([MI) and l|2Ij> ). ,-From (JSU), (13361 . inequality (13571) and 
Lemma [191 one obtains (|92p . Theorem 1151 is proved. □ 



4.4 Proofs of the nonlinear inequalities 



rt r \j 

Proof. [Proof of Theorem 116] Denote w(t) := g(i)e Jr o 7W s . Then inequality ([9 
the form 

w{t) < a(t)w p {t) + b(t), w{t ) = g{T ) := go, 



where 
Denote 



a(t) := a(t)e {1 - p)f ^ s)ds , b(t) := (3(t)J^ ds . 



e .C 7(s)ds 



^From inequality ([96]) and relation (|360p one gets 

1 



w(t ) = g(r ) < 



m(t"o) 



takes 
(358) 

(359) 
(360) 

(361) 



It follows from the inequalities (|136p . (|358p and (|36ip that 



w(t ) < a(T )—^- + P(t ) < ' 



m(to) 



7 



A (to) 

M r o) 



d e 



Ir 70)*> 



7?(r ). (362) 



t=T 



^From the inequalities (|36ip and (|362p it follows that there exists 5 > such that 

«;(*) < rj(t), T <t<T + 5. (363) 

To continue the proof we need two Claims. 
Claim 1. If 

w(t)< V (t), VtG[r ,T], T>r , (364) 
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then 

w(t)<f](t), VtG[r ,T]. (365) 

Proof of Claim 1. 

It follows from inequalities ([95]) . (|358p and the inequlity w(T) < r)(T), that 

p J 7(s)ds 

u;(t) < e (1 " p) ^ 7(B)dB a(t) e ^ + /?(*)e J -o ^ s)ds 



e T o 



M(t) 



Aft) 



(366) 



d e Jr o 



dt n(t) 



= #), VtG[r ,T]. 



Claim 1 is proved. 
Denote 

T := sup{5 E M+ : «;(*) < »j(t), Vt 6 [r , r + <5]}. (367) 

Claim 2. One has T = oo. 

Claim 2 says that every nonnegative solution g(i) to inequality (1), satisfying assump- 
tion (3), is defined globally 

Proof of Claim 2. 

Assume the contrary, i.e., T < oo. ^From the definition of T and the continuity of w 
and n one gets 

w(T) < T](T). (368) 
It follows from inequality (|368p and Claim 1 that 

w(t)<v(t), Vie[r ,T]. (369) 

This implies 

w{T)-w(t )= f w(s)ds< f fj(s)ds = rj(T) -rj(r ). (370) 

Since w{tq) < 17(70) by assumption ([96]) . it follows from inequality (|370p that 

u>(T) < i?(T). (371) 

Inequality (|371j) and inequality (j369p with t = T imply that there exists an e > such 
that 

w(t)<rj(t), T<t<T + e. (372) 

This contradicts the definition of T in (|367j) . and the contradiction proves the desired 
conclusion T = 00. 
Claim 2 is proved. 

It follows from the definitions of n(t) and w(t) and from the relation T = 00 that 

ff (t) = < e - = -L, Vt > r . (373) 

/x(t) 

Theorem [TU] is proved. □ 
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4.4.1 Proof of Theorem 

Proof. [Proof of Theorem 1 18| Let us prove (|1U7|) by induction. Inequality (|1U7|) holds for 
n = by assumption (|106p . Suppose that (|10T|) holds for all n < m. From inequalities 
(|103p . (|105p . and from the induction hypothesis g n < n < m, one gets 

9rn+l ^ 9m(\ ^m7m) &mhrn9rn hmftm 
^ (1 ^-rnTm) ~\~ h m p- -\- h m (3 m 
. 1 , , h m / — M 

< — (1 - n m 7m) H 7i 



\ — lit /lit/ ' I I lit l 

1 /x m+ i - (374) 



Mm Mm 



(Mm+1 — Mm)( _ T" 



2 

Mm+1 Mm l^ml^m+l 
1 (Mrn+1 — Mm) 2 < !_ 



9 

Mm+1 MnMm+1 Mm+1 



Therefore, inequality (|107j) holds for n = m+ 1. Thus, inequality (|107p holds for all n > 
by induction. Theorem [18] is proved. □ 



5 Applications of the nonlinear inequality ( I94| ) 

Here we only sketch the idea for many possible applications of this inequality for a study 
of dynamical systems in a Hilbert space. 
Let 

du 

ii = Au + h(t,u) + f(t), u(0)=u , u:=— , t > 0, (375) 

at 

where A is a selfadjoint operator in a real Hilbert space, h(t, u) is a nonlinear operator 
in H, which is locally Lipschitz with respect to u and Holder-continuous with respect to 
t E M + := [0, oo), and / is a Holder continuous function on M + with values in H. 
Assume that 

Re(Au,u) < -<y(t)(Au,u), Re{h(t, u), u) < a(t)\\u\\ 1+p VueD(A), (376) 

where j(t) and a(t) are continuous functions on R + , h(t, 0) = 0, p > 1 is a constant. 

Our aim is to estimate the behavior of solutions to (I375h as t — > oo, in particular, 
to give sufficient conditions for a global existence of the unique solution to (|375p . Our 
approach consists of a reduction of the problem to the inequality (|94p and an application 
of Theorem [16j 

Let g(t) := Problem (|375p has a unique local solution under our assumptions. 

Multiplying (|375p by u from left, then from right, add, and use (13761) to get 

99 < -l{t)g 2 + a(t)g 1+ f + 0(t)g, (3(t) := Re(/(t), u). (377) 

Since g > 0, one gets 

g<-j(t)g + a(t)g p (t)+P(t). (378) 
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Now Theorem [16] is applicable. This Theorem yields sufficient conditions (|95p and 
(|96p for the global existence of the solution to (|375p and estimate (j97[) for the behavior of 
||n(t)|| as t — > oo. 

The outlined scheme is widely applicable to stability problems, to semilinear parabolic 
problems, and to hyperbolic problems as well. It yields some novel results. For instance, if 
the operator A is a second-order elliptic operator with matrix a,ij(x,t), then Theorem [TBI 
allows one to treat degenerate problems, namely, it allows, for example, the minimal 
eigenvalue X(x,t) of a selfadjoint matrix aij(x,t) to depend on time in such a way that 
mmj, \(x, t) := X(t) — > as t — ► oo at a certain rate. 



6 A numerical experiment 

Let us present results of a numerical experiment. We solve nonlinear equation flTJ with 

F(u) := B(u) + (arctan(n)) 3 := f e'^u(y)dy + (arctan(u)) 3 . (379) 

Jo 

Since the function u — > arctan 3 u is increasing on M, one has 

(( arctan(rt)) 3 — ( arctan(u)) 3 , u — v) > 0, Vu,v£H. (380) 



Moreover, 

i /'oo iXx 

7 d\. (381) 



vr 1 + A 2 
Therefore, {B(u — v), u — v) > 0, so 

-«),«-«) >0, \/u,veH. (382) 

The Frechet derivative of i* 1 is: 

, 3( arctan(u)) 2 Z" 1 , , , , 

F'(u)w = -± t 2J ~w+ e~ lx - yl w(y)dy. 383 

1 + vr Jo 

If u(x) vanishes on a set of positive Lebesgue's measure, then F'(u) is not boundedly 
invertible in H. If u € C[0, 1] vanishes even at one point xq, then F'(u) is not boundedly 
invertible in H. 

We use the following iterative scheme 

u n+1 = u n - (F'(u n ) + a n I)~ l (F(u n ) + a n u n - f s ), 
Uq = 0, 

and stop iterations at n := ns such that the following inequality holds 

\\F(u ns ) - f s \\ <C5\ \\F{u n ) - M| > CP, n<n s , C > 1, 7 e(0,l). (385) 

The existence of the stopping time ns is proved and the choice uq = is also justified 
in this paper. The drawback of the iterative scheme (I384p compared to the DSM in this 
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paper is that the solution u ng may converge not to the minimal-norm solution to equation 
(PQ) but to another solution to this equation, if this equation has many solutions. There 
might be other iterative schemes which are more efficient than scheme (|384p . but this 
scheme is simple and easy to implement. 

Integrals of the form J* Q e~^ x ~ y ^h(y)dy in (|379p and (|383p are computed by using the 
trapezoidal rule. The noisy function used in the test is 

fs(x) = f(x) + Kf noise (x), k > 0. 

The noise level 5 and the relative noise level are defined by the formulas: 

^ = K ll f noise ||; $rel := ii^ii ■ 

In the test k is computed in such a way that the relative noise level 5 re i equals to some 
desired value, i.e., 

<5 $rel I 



1 1 f noise \ | || f noise \\ 

We have used the relative noise level as an input parameter in the test. 

In the test we took h = 1, C = 1.01, and 7 = 0.99. The exact solution in the first test 
is u(x) = 1, and the right-hand side is / = ^(1). 

It is proved that one can take a n = j4^, and d is sufficiently large. However, in 
practice, if we choose d too large, then the method will use too many iterations before 
reaching the stopping time rig in (|385|) . This means that the computation time will be 
large in this case. Since 

\\F(V S ) - f 5 \\ = a(t)\\V s l 
and \\V s {t s ) - u s (t s )\\ = 0(a(t 5 )), we have 

CP = \\F(u s (t s )) - f 5 \\ < a(t s )\\V s \\ + 0(a(t s )), 

and we choose 

d = C 5~<, Co > 0. 

In the experiments our method works well with Co G [3, 10]. In the test we chose a n by 

ro.99 

the formula a n := Co^rf. The number of nodal points, used in computing integrals in 
(|379p and (|383p . was N = 50. The accuracy of the solutions obtained in the tests with 
N = 20 and N = 30 was about the same as for N = 50. 

Numerical results for various values of 5 re i are presented in Table [H In this experiment, 
the noise function f noise is a vector with random entries normally distributed, with mean 
value and variance 1. Table [U shows that the iterative scheme yields good numerical 
results. 
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